A robot shaped like a human--white with a black head and torso--has been popping up on video feeds. Perhaps you've seen it dance or pass popcorn, put trash in a bin, vacuum, or press the button of a microwave. Or maybe you've watched it fall backward while handing out water bottles or struggle to iron a shirt. This would be Tesla's Optimus, an AI-powered humanoid robot that Elon Musk, the company's CEO, believes will be "not just Tesla's biggest product ever, but probably the biggest product ever," headed to work on factory floors and, later, in our homes. Eventually it "will have human and then superhuman dexterity," he told shareholders in July. Optimus robots could automate almost all human labor--from hauling sheet metal to folding laundry--for as little as $20,000 each, Musk argues. Speaking at the World Economic Forum's annual meeting in Davos, Switzerland, in January, he predicted they could be on sale to the public by the end of 2027.

This document serves as a position paper that outlines the authors' vision for a potential pathway towards generalist robots. The purpose of this document is to share the excitement of the authors with the community and highlight a promising research direction in robotics and AI. The authors believe the proposed paradigm is a feasible path towards accomplishing the long-standing goal of robotics research: deploying robots, or embodied AI agents more broadly, in various non-factory real-world settings to perform diverse tasks. This document presents a specific idea for mining knowledge in the latest large-scale foundation models for robotics research. Instead of directly using or adapting these models to produce low-level policies and actions, it advocates for a fully automated generative pipeline (termed as generative simulation), which uses these models to generate diversified tasks, scenes and training supervisions at scale, thereby scaling up low-level skill learning and ultimately leading to a foundation model for robotics that empowers generalist robots. The authors are actively pursuing this direction, but in the meantime, they recognize that the ambitious goal of building generalist robots with large-scale policy training demands significant resources such as computing power and hardware, and research groups in academia alone may face severe resource constraints in implementing the entire vision. Therefore, the authors believe sharing their thoughts at this early stage could foster discussions, attract interest towards the proposed pathway and related topics from industry groups, and potentially spur significant technical advancements in the field.